- Title
- A matter of significance: can sampling error invalidate cloze estimates of text readability?
- Creator
- O'Toole, John Mitchell; King, Robert A. R.
- Relation
- Language Assessment Quarterly Vol. 7, Issue 4, p. 303-316
- Relation
- http://www.tandfonline.com/toc/hlaq20/7/4
- Publisher
- Routledge
- Resource Type
- journal article
- Date
- 2010
- Description
- This quantitative study intends to better understand the impact of the location of the first deleted word upon the estimation of text difficulty yielded by successive cloze tests based on random deletion from a single passage. The variation in sampling of language features across five cloze tests based on the same passage is random and thus not statistically significant. However, there is a statistically significant difference in result distributions of matched groups after scoring for exact replacement. These differences in performance appear partly due to differences in the frequencies of nouns, verbs, and grammatical metaphor between the different tests derived from the base passage. Although the differences between the tests in this investigation appear to fall within the tolerances indicated by commonly used criterion scores, the range of mean scores for particular school grades suggests that more generalised estimation of text difficulty should be based on exhaustive sampling rather than relying on one test based on a specific passage. This study is significant because it illuminates widespread concerns regarding the usefulness of cloze techniques for the purpose for which they were first devised and suggests reasons for the impact of two forms of sampling error.
- Subject
- cloze testing; text readability; sampling errors; school grades
- Identifier
- http://hdl.handle.net/1959.13/926651
- Identifier
- uon:9900
- Identifier
- ISSN:1543-4303
- Language
- eng
- Reviewed
- Hits: 1401
- Visitors: 1635
- Downloads: 1
| Thumbnail | File | Description | Size | Format |
|---|